InĀ [1]:
from pathlib import Path
from compare import ReferenceComparer, get_last_two_commits
Find commits to compareĀ¶
By default, the notebook compares last two commits(ref1hash is the older one and ref2hash is the newer one). You can customise this by changing the ref1_hash and ref2_hash variables or by providing REF1_HASH and REF2_HASH commit values. You can also provide custom spectrum paths for the two hashes with respect to the root directory for that commit.
InĀ [2]:
import os
ref1_hash = os.getenv('REF1_HASH')
ref2_hash = os.getenv('REF2_HASH')
if not (ref1_hash and ref2_hash):
ref1_hash, ref2_hash = get_last_two_commits()
if not (ref1_hash and ref2_hash):
raise ValueError("Could not get commit hashes.")
if os.getenv('CUSTOM_REF1_SPECTRUM_PATH'):
custom_ref1_spectrum_path = os.getenv('CUSTOM_REF1_SPECTRUM_PATH')
else:
custom_ref1_spectrum_path = 'tardis/spectrum/tests/test_spectrum_solver/test_spectrum_solver/TestSpectrumSolver.h5'
if os.getenv('CUSTOM_REF2_SPECTRUM_PATH'):
custom_ref2_spectrum_path = os.getenv('CUSTOM_REF2_SPECTRUM_PATH')
else:
custom_ref2_spectrum_path = 'tardis/spectrum/tests/test_spectrum_solver/test_spectrum_solver/TestSpectrumSolver.h5'
InĀ [3]:
ref1_hash, ref2_hash
Out[3]:
('84e768462f20f09fbccc05625cdcc1d8ffbe404c',
'2420fac6f03195b969d9a1da864ee160e19d9786')
Example ValuesĀ¶
Below are example values you can test the notebook with.
InĀ [4]:
# ref1_hash="170f1a2c0d8c6db518a4b9a0f4cb9b657aaa61b6"
# ref2_hash="d9fd3bb659d185bd9ece10b8e2175cf497ea84c5"
# custom_ref1_spectrum_path = 'tardis/spectrum/tests/test_spectrum_solver/test_spectrum_solver/TestSpectrumSolver.h5'
# custom_ref2_spectrum_path = 'test_spectrum_solver/test_spectrum_solver/TestSpectrumSolver.h5'
Initialise the ReferenceComparer classĀ¶
InĀ [5]:
comparer = ReferenceComparer(ref1_hash=ref1_hash, ref2_hash=ref2_hash, print_path=True)
comparer.setup()
comparer.diff_analyzer.display_diff_tree(comparer.dcmp)
Created temporary directory at /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7
ā .github/ ā ā actions/ ā ā ā setup_env/ ā ā workflows/ ā arepo_data/
ā atom_data/
ā ā nlte_atom_data/ ā ā stardis_atom_data/
ā tardis/ ā ā opacities/ ā ā ā tests/ ā ā ā ā test_tau_sobolev/ ā ā plasma/ ā ā ā equilibrium/ ā ā ā ā tests/ ā ā ā ā ā test_level_populations/ ā ā ā ā ā ā test_level_population_solver/ ā ā ā ā ā test_rate_matrix/ ā ā ā tests/ ā ā ā ā test_complete_plasmas/ ā ā ā ā ā test_plasma/
ā ā ā ā test_hdf_plasma/ ā ā ā ā test_nlte_excitation/ ā ā ā ā test_nlte_solver/ ā ā ā ā test_plasma_continuum/ ā ā ā ā test_tardis_model_density_config/ ā ā simulation/ ā ā ā tests/ ā ā ā ā test_simulation/ ā ā spectrum/ ā ā ā tests/ ā ā ā ā test_spectrum_solver/ ā ā ā ā ā test_spectrum_solver/
ā ā tests/ ā ā ā test_tardis_full/ ā ā ā ā test_transport_simple/
ā ā ā test_tardis_full_formal_integral/ ā ā ā ā test_transport_simple_formal_integral/ ā ā transport/ ā ā ā montecarlo/ ā ā ā ā tests/ ā ā ā ā ā test_continuum/ ā ā ā ā ā ā± test_montecarlo_continuum.h5 ā ā ā ā ā test_montecarlo_main_loop/
ā ā ā ā ā test_packet_source/ ā ā ā ā ā ā test_black_body_simple_source/ ā ā ā ā ā ā test_black_body_simple_source_rel/ ā ā ā ā ā test_rpacket_tracker/ ā ā ā ā ā test_weighted_packet_source/ ā ā ā ā ā ā test_black_body_weighted_source/ ā ā visualization/ ā ā ā tools/ ā ā ā ā tests/ ā ā ā ā ā test_liv_plot/ ā ā ā ā ā ā test_liv_plotter/ ā ā ā ā ā test_sdec_plot/ ā ā ā ā ā ā test_sdec_plotter/
InĀ [6]:
comparer.compare()
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field' Error comparing item: /plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/j_blues Maximum relative difference: 1.59e-14 (Versions differ by 1.59e-12%)
Error comparing item: /simulation/plasma/determine_bf_macro_activation_idx unsupported operand type(s) for -: 'CPUDispatcher' and 'CPUDispatcher' Displaying heatmap for key /simulation/plasma/j_blues in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.5e-23 | 5.8e-24 | 5.6e-24 | 3.7e-24 | 3.3e-24 |
| max | 2.7e-20 | 2e-20 | 1.4e-20 | 1e-20 | 1e-20 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.4e-18 | 6.2e-19 | 1.8e-18 | 1.7e-18 | 1.4e-18 |
| max | 1.6e-14 | 1.2e-14 | 1.6e-14 | 1.4e-14 | 6.4e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/j_estimator in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 0.022 |
| max | 0.031 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 3.7e-16 |
| max | 5.6e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/alpha_stim_factor in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.6e-14 | 4.6e-14 | 2.1e-14 | 4.8e-14 | 1.1e-14 |
| max | 2.9e-11 | 2.9e-11 | 1.5e-11 | 1.5e-11 | 7.3e-12 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.6e-19 | 7.3e-19 | 4.6e-19 | 1.2e-18 | 5.2e-19 |
| max | 1.8e-16 | 3.4e-16 | 2e-16 | 2.8e-16 | 2.2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/level_absorption_probs Maximum relative difference: 1.50e+00 (Versions differ by 1.50e+02%)
Displaying heatmap for key /simulation/plasma/level_absorption_probs in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | transition_type | lines_idx | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 3.3e-17 | 5.8e-18 | 1.9e-18 | 6.6e-19 | 9.7e-19 |
| max | 0 | 0 | 8.7e-13 | 1e-13 | 3.8e-14 | 1.2e-14 | 1.9e-14 |
Visualising Relative Differences
| Ā | transition_type | lines_idx | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 0.0015 | 0.0029 | 5.2e-15 | 2e-15 | 3.1e-15 |
| max | 0 | 0 | 1 | 1.5 | 9.3e-14 | 5e-14 | 1e-13 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/output_nu in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 0.13 |
| max | 0.25 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 1.2e-16 |
| max | 2.4e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/phi_ik in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.3e+20 | 1.2e-39 | 1.5e-40 | 9.1e-39 | 3.2e-40 |
| max | 6e+23 | 3e-36 | 1.9e-37 | 2.4e-35 | 7.5e-37 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.8e-19 | 1.8e-19 | 3.2e-19 | 1.8e-19 | 1.6e-19 |
| max | 2.5e-16 | 1.7e-16 | 2.1e-16 | 1.8e-16 | 2.3e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/level_number_density in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9.6e-25 | 6.6e-25 | 1.1e-26 | 1e-26 | 1.6e-28 |
| max | 2.5e-21 | 1.7e-21 | 1.3e-23 | 2.6e-23 | 4.1e-25 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.1e-19 | 1.1e-19 | 3.5e-19 | 2.3e-19 | 1e-19 |
| max | 4.1e-16 | 1.4e-16 | 2.6e-16 | 2.3e-16 | 1.4e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/transition_probabilities Maximum relative difference: 1.50e+00 (Versions differ by 1.50e+02%)
Displaying heatmap for key /simulation/plasma/transition_probabilities in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3e-17 | 5.8e-18 | 1.8e-18 | 5.9e-19 | 8.7e-19 |
| max | 8.7e-13 | 1e-13 | 4.1e-14 | 1.2e-14 | 1.9e-14 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0.0013 | 0.0025 | 4.6e-15 | 1.8e-15 | 2.8e-15 |
| max | 1 | 1.5 | 1.1e-12 | 5e-14 | 1e-13 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Error comparing item: /simulation/plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Displaying heatmap for key /simulation/plasma/chi_bf in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.6e-39 | 2.9e-44 | 5.3e-45 | 5.8e-43 | 6e-41 |
| max | 1.5e-33 | 7.3e-40 | 2.3e-41 | 5.6e-37 | 6e-35 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.4e-19 | 2.9e-20 | 2.3e-19 | 2.1e-19 | 1.3e-20 |
| max | 8.4e-16 | 4.3e-16 | 5.7e-16 | 4.1e-16 | 3.6e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/spectrum_solver/spectrum_real_packets/luminosity_density_lambda Maximum relative difference: 1.43e-14 (Versions differ by 1.43e-12%)
Error comparing item: /simulation/plasma/yg_interp unsupported operand type(s) for -: 'PchipInterpolator' and 'PchipInterpolator' Displaying heatmap for key /simulation/spectrum_solver/spectrum_real_packets/luminosity_density_lambda in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 1.1e+33 |
| max | 2.2e+33 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 7.2e-15 |
| max | 1.4e-14 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/p_recomb in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 5.7e-45 | 3.9e-45 | 1e-44 | 2.2e-44 | 2.9e-45 |
| max | 5.7e-42 | 5.7e-42 | 1.1e-41 | 2.3e-41 | 2.9e-42 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.7e-19 | 4.6e-19 | 5.4e-19 | 8.1e-19 | 5.3e-19 |
| max | 4e-16 | 4.1e-16 | 2.8e-16 | 3.3e-16 | 3.9e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/p_fb_deactivation in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.3e-25 | 2.7e-20 | 1.4e-26 | 1.4e-26 | 1.9e-27 |
| max | 1.1e-22 | 2.8e-17 | 6.6e-24 | 1.3e-23 | 1.7e-24 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9.6e-19 | 1.2e-18 | 7.8e-19 | 5.7e-19 | 5e-19 |
| max | 6.6e-16 | 2.4e-16 | 2.2e-16 | 3.4e-16 | 2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Error comparing item: /simulation/plasma/get_current_bound_free_continua unsupported operand type(s) for -: 'CPUDispatcher' and 'CPUDispatcher' Displaying heatmap for key /simulation/plasma/p_photo_ion in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.3e-24 | 4.9e-24 | 0 | 1.6e-24 | 2.6e-24 |
| max | 3.4e-21 | 1.7e-21 | 0 | 8.5e-22 | 1.3e-21 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.2e-19 | 7.4e-19 | 0 | 3.7e-19 | 2.9e-18 |
| max | 2.3e-16 | 2.4e-16 | 0 | 2e-16 | 2e-15 |
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/spectrum_solver/spectrum_real_packets/luminosity Maximum relative difference: 1.41e-14 (Versions differ by 1.41e-12%)
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/spectrum_solver/spectrum_real_packets/luminosity in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 7.7e+25 |
| max | 1.5e+26 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 7.1e-15 |
| max | 1.4e-14 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/coll_ion_coeff in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 3.2e-27 | 1.3e-26 | 0 | 2.6e-26 |
| max | 0 | 3.3e-24 | 1.3e-23 | 0 | 1.3e-23 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 1.5e-19 | 3.6e-19 | 0 | 4.6e-19 |
| max | 0 | 1.6e-16 | 3.7e-16 | 0 | 2.6e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/coll_exc_coeff in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 7.4e-24 | 7.6e-24 | 8.8e-24 | 7.1e-24 | 7.3e-24 |
| max | 2.7e-20 | 2.7e-20 | 5.4e-20 | 1.4e-20 | 1.4e-20 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.5e-17 | 1.4e-17 | 1.4e-17 | 1.4e-17 | 1.5e-17 |
| max | 1.1e-15 | 1.1e-15 | 8.7e-16 | 8.5e-16 | 1e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/coll_deexc_coeff in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9.9e-24 | 1.1e-23 | 1e-23 | 9e-24 | 9.6e-24 |
| max | 2.7e-20 | 2.7e-20 | 2.7e-20 | 2.7e-20 | 2.7e-20 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.5e-17 | 1.5e-17 | 1.4e-17 | 1.5e-17 | 1.5e-17 |
| max | 1.1e-15 | 1.1e-15 | 9.6e-16 | 9.7e-16 | 1.1e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/yg_data in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 2000 | 5000 | 10000 | 20000 | 50000 | 100000 | 200000 | 500000 | 1000000 |
|---|---|---|---|---|---|---|---|---|---|
| mean | 4.7e-17 | 6.6e-17 | 1.1e-16 | 8.2e-17 | 3.9e-17 | 2.2e-17 | 9.1e-18 | 5.7e-18 | 6.4e-18 |
| max | 1.7e-13 | 2.3e-13 | 2.3e-13 | 2.3e-13 | 1.1e-13 | 2.3e-13 | 1.1e-13 | 8.5e-14 | 1.1e-13 |
Visualising Relative Differences
| Ā | 2000 | 5000 | 10000 | 20000 | 50000 | 100000 | 200000 | 500000 | 1000000 |
|---|---|---|---|---|---|---|---|---|---|
| mean | 2.8e-18 | 6e-18 | 1.2e-17 | 1.5e-17 | 1.4e-17 | 1.1e-17 | 9e-18 | 2.5e-18 | 1.1e-18 |
| max | 5.9e-16 | 6.3e-16 | 8.2e-16 | 7.2e-16 | 7.5e-16 | 6.6e-16 | 6.9e-16 | 5.5e-16 | 6.3e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/R Maximum relative difference: 1.50e+00 (Versions differ by 1.50e+02%)
Displaying heatmap for key /simulation/plasma/R in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 6.3e-17 | 1.4e-17 | 0 | 0 | 0 |
| max | 2.8e-14 | 9e-15 | 0 | 0 | 0 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0.0015 | 0.0029 | 0 | 0 | 0 |
| max | 1 | 1.5 | 0 | 0 | 0 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/fb_emission_cdf in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.8e-19 | 4.3e-20 | 1.6e-19 | 3.1e-20 | 1.2e-19 |
| max | 2.2e-16 | 1.1e-16 | 1.1e-16 | 2.2e-16 | 2.2e-16 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.2e-19 | 1.3e-19 | 2.7e-19 | 1.2e-19 | 2.6e-19 |
| max | 4.7e-16 | 4.4e-16 | 4.4e-16 | 4.7e-16 | 4.3e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/lte_level_number_density in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.2e-25 | 6.7e-25 | 8.1e-27 | 2e-26 | 1.6e-28 |
| max | 8.5e-22 | 1.7e-21 | 1.3e-23 | 5.3e-23 | 4.1e-25 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2e-19 | 2e-19 | 3.8e-19 | 2.7e-19 | 1.5e-19 |
| max | 2.2e-16 | 2.2e-16 | 3.7e-16 | 4.1e-16 | 2.3e-16 |
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/deactivation_channel_probs Maximum relative difference: 5.46e-13 (Versions differ by 5.46e-11%)
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/deactivation_channel_probs in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | lines_idx | transition_type | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 1.4e-17 | 1.1e-17 | 9.6e-25 | 5.9e-21 | 1.4e-24 |
| max | 0 | 0 | 1.3e-13 | 9.7e-14 | 2.7e-20 | 1.1e-16 | 5.4e-20 |
Visualising Relative Differences
| Ā | lines_idx | transition_type | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 3.2e-16 | 1.9e-16 | 2.4e-20 | 1.2e-18 | 1.5e-20 |
| max | 0 | 0 | 5.5e-13 | 3.3e-13 | 3.4e-16 | 3.7e-14 | 2.2e-16 |
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/tau_sobolevs Maximum relative difference: 2.37e-14 (Versions differ by 2.37e-12%)
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/tau_sobolevs in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.2e-24 | 2.3e-25 | 8e-27 | 5.4e-28 | 1.1e-28 |
| max | 3.9e-20 | 6.8e-21 | 2.6e-22 | 1.3e-23 | 2.1e-24 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4e-18 | 6.2e-19 | 1.1e-18 | 5.4e-19 | 2.3e-19 |
| max | 2.4e-14 | 5.5e-15 | 1.1e-14 | 4.4e-15 | 7.4e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/stimulated_emission_factor Maximum relative difference: 2.37e-14 (Versions differ by 2.37e-12%)
Displaying heatmap for key /simulation/plasma/stimulated_emission_factor in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.9e-19 | 6.4e-20 | 1.3e-19 | 7.2e-20 | 3.7e-20 |
| max | 4.4e-16 | 2.2e-16 | 2.2e-16 | 2.2e-16 | 2.2e-16 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.8e-18 | 5.5e-19 | 9.9e-19 | 2.9e-19 | 7e-20 |
| max | 2.4e-14 | 5.5e-15 | 1.1e-14 | 4.4e-15 | 5.6e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/p_coll in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 7e-24 | 1.4e-24 | 3.9e-25 | 9e-26 | 3.4e-26 |
| max | 2.7e-20 | 5.1e-21 | 3.4e-21 | 2.1e-22 | 1.1e-22 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.5e-17 | 1.5e-17 | 1.4e-17 | 1.5e-17 | 1.5e-17 |
| max | 1.1e-15 | 1.2e-15 | 1.1e-15 | 1e-15 | 1.1e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/alpha_stim in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.2e-35 | 1.7e-35 | 9e-36 | 7.5e-36 | 1.9e-34 |
| max | 6.2e-33 | 9.2e-33 | 3.1e-33 | 3.1e-33 | 2e-31 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 6.1e-19 | 1.2e-18 | 4.7e-19 | 1.1e-18 | 6.2e-19 |
| max | 2.3e-16 | 4.5e-16 | 1.8e-16 | 2.5e-16 | 3.2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/thermal_lte_level_boltzmann_factor in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.2e-20 | 2.6e-24 | 2.6e-21 | 8.2e-21 | 2.1e-20 |
| max | 2.8e-17 | 6.8e-21 | 6.9e-18 | 1.4e-17 | 5.6e-17 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.3e-19 | 1.6e-19 | 3.1e-19 | 2.6e-19 | 1.2e-19 |
| max | 2.2e-16 | 1.6e-16 | 2.2e-16 | 3e-16 | 1.7e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/non_continuum_trans_probs Maximum relative difference: 1.09e-12 (Versions differ by 1.09e-10%)
Displaying heatmap for key /simulation/plasma/non_continuum_trans_probs in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | lines_idx | transition_type | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 3.3e-18 | 3.9e-18 | 1.6e-18 | 7.5e-21 | 1.2e-19 |
| max | 0 | 0 | 3.2e-14 | 7.2e-14 | 4.1e-14 | 2.8e-16 | 4e-15 |
Visualising Relative Differences
| Ā | lines_idx | transition_type | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|---|---|
| mean | 0 | 0 | 2.5e-16 | 3.6e-16 | 1.6e-16 | 1.4e-18 | 1.3e-17 |
| max | 0 | 0 | 1.1e-12 | 1.1e-12 | 1.1e-12 | 1.4e-14 | 9e-14 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/p_combined Maximum relative difference: 7.16e-13 (Versions differ by 7.16e-11%)
Displaying heatmap for key /simulation/plasma/p_combined in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.5e-18 | 5.8e-18 | 4.7e-22 | 1.3e-21 | 1.9e-22 |
| max | 6e-14 | 9.4e-14 | 1e-17 | 2.8e-17 | 6.9e-18 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.6e-16 | 3.7e-16 | 8.7e-19 | 1.1e-18 | 6.6e-19 |
| max | 7.2e-13 | 3.6e-13 | 1e-15 | 3.7e-14 | 1.6e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/packet_luminosity in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 1.2e+24 |
| max | 2.4e+24 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 1e-16 |
| max | 2.1e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/general_level_boltzmann_factor in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.2e-20 | 2.6e-24 | 2.6e-21 | 8.2e-21 | 2.1e-20 |
| max | 2.8e-17 | 6.8e-21 | 6.9e-18 | 1.4e-17 | 5.6e-17 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.3e-19 | 1.6e-19 | 3.1e-19 | 2.6e-19 | 1.2e-19 |
| max | 2.2e-16 | 1.6e-16 | 2.2e-16 | 3e-16 | 1.7e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/B Maximum relative difference: 1.50e+00 (Versions differ by 1.50e+02%)
Displaying heatmap for key /simulation/plasma/B in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.3e-17 | 5.8e-18 | 1.9e-18 | 6.6e-19 | 9.7e-19 |
| max | 8.7e-13 | 1e-13 | 3.8e-14 | 1.2e-14 | 1.9e-14 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0.0015 | 0.0029 | 5.2e-15 | 2e-15 | 3.1e-15 |
| max | 1 | 1.5 | 9.3e-14 | 5e-14 | 1e-13 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/j_blue_estimator in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.5e-36 | 5.6e-36 | 7.6e-36 | 7.1e-36 | 4.9e-36 |
| max | 3.1e-33 | 3.1e-33 | 3.1e-33 | 3.1e-33 | 1.5e-33 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.6e-19 | 4.8e-18 | 1.3e-17 | 1.6e-17 | 1.3e-17 |
| max | 3.3e-16 | 4.2e-16 | 6.6e-16 | 6.6e-16 | 6.6e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/p_coll_ion in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 4e-28 | 4e-28 | 0 | 1e-28 |
| max | 0 | 4.1e-25 | 4.1e-25 | 0 | 5.2e-26 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 1.3e-19 | 2.9e-19 | 0 | 4.6e-19 |
| max | 0 | 1.3e-16 | 3e-16 | 0 | 2.5e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/boltzmann_factor_photo_ion in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9.1e-21 | 8.5e-21 | 8.5e-21 | 9.3e-21 | 8.1e-21 |
| max | 5.6e-17 | 5.6e-17 | 1.1e-16 | 1.1e-16 | 1.1e-16 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.8e-19 | 2.8e-19 | 2.7e-19 | 2.7e-19 | 2.8e-19 |
| max | 2.2e-16 | 2.2e-16 | 2.2e-16 | 2.2e-16 | 2.2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/c_fb_sp in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 6.3e-45 | 1.3e-44 | 7.4e-46 | 1.4e-45 | 8.3e-46 |
| max | 5.7e-42 | 1.1e-41 | 3.6e-43 | 1.4e-42 | 7.2e-43 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.1e-18 | 1.2e-18 | 6.6e-19 | 2.8e-19 | 5.7e-19 |
| max | 4.2e-16 | 2.1e-16 | 1.8e-16 | 1.7e-16 | 2.3e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/N Maximum relative difference: 1.67e-12 (Versions differ by 1.67e-10%)
Displaying heatmap for key /simulation/plasma/N in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.1e-12 | 4.8e-14 | 4.8e-15 | 7.2e-16 | 7.3e-16 |
| max | 1.4e-08 | 3.8e-10 | 4.8e-11 | 8.4e-12 | 9.6e-12 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 6e-14 | 1.3e-14 | 5.1e-15 | 2e-15 | 3.1e-15 |
| max | 1.7e-12 | 4.2e-13 | 9.3e-14 | 5e-14 | 1e-13 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/alpha_sp in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 5.7e-34 | 2.4e-34 | 1.1e-33 | 2.1e-33 | 2.9e-34 |
| max | 3.9e-31 | 2e-31 | 7.9e-31 | 1.6e-30 | 2e-31 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 5.3e-19 | 3.7e-19 | 6.1e-19 | 9.2e-19 | 5.3e-19 |
| max | 4.2e-16 | 2.3e-16 | 2.2e-16 | 3e-16 | 3.5e-16 |
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/non_markov_transition_probabilities Maximum relative difference: 1.09e-12 (Versions differ by 1.09e-10%)
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/non_markov_transition_probabilities in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 4.1e-18 | 5.5e-18 | 6.5e-19 | 1.6e-20 | 5.1e-20 |
| max | 6e-14 | 9.4e-14 | 4.1e-14 | 9e-16 | 4e-15 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.2e-16 | 3.8e-16 | 6.7e-17 | 1.8e-18 | 5.5e-18 |
| max | 1.1e-12 | 1.1e-12 | 1.1e-12 | 3.7e-14 | 9e-14 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/level_boltzmann_factor in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.2e-20 | 2.6e-24 | 2.6e-21 | 8.2e-21 | 2.1e-20 |
| max | 2.8e-17 | 6.8e-21 | 6.9e-18 | 1.4e-17 | 5.6e-17 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.3e-19 | 1.6e-19 | 3.1e-19 | 2.6e-19 | 1.2e-19 |
| max | 2.2e-16 | 1.6e-16 | 2.2e-16 | 3e-16 | 1.7e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/gamma_corr in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.1e-13 | 3.1e-13 | 0 | 5.7e-14 | 1.2e-13 |
| max | 1.2e-10 | 1.2e-10 | 0 | 2.9e-11 | 5.8e-11 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.5e-19 | 8e-19 | 0 | 2.5e-19 | 2.8e-18 |
| max | 1.5e-16 | 2.7e-16 | 0 | 1.3e-16 | 2e-15 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/plasma/cool_rate_fb in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.2e-28 | 8.2e-25 | 2.6e-32 | 1.6e-33 | 5.4e-35 |
| max | 1e-25 | 8.5e-22 | 1.3e-29 | 1.6e-30 | 4.9e-32 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 8.9e-19 | 1.3e-18 | 8.4e-19 | 4.4e-19 | 6.8e-19 |
| max | 5.8e-16 | 2.6e-16 | 2.4e-16 | 2.7e-16 | 2.7e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Error comparing item: /simulation/plasma/determine_continuum_macro_activation_idx unsupported operand type(s) for -: 'CPUDispatcher' and 'CPUDispatcher'
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/p_rad_bb Maximum relative difference: 7.16e-13 (Versions differ by 7.16e-11%)
Displaying heatmap for key /simulation/plasma/p_rad_bb in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.3e-20 | 3.1e-21 | 1.5e-25 | 6.5e-26 | 9e-26 |
| max | 3.5e-16 | 1.3e-16 | 6.8e-21 | 1.7e-21 | 5.1e-21 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 5.9e-17 | 3.4e-17 | 7.4e-19 | 1.4e-18 | 5.4e-19 |
| max | 7.2e-13 | 4.7e-13 | 1.6e-14 | 3.7e-14 | 5.2e-15 |
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/p_deactivation Maximum relative difference: 5.46e-13 (Versions differ by 5.46e-11%)
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/p_deactivation in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.4e-17 | 1.1e-17 | 9.8e-25 | 6.1e-21 | 1.5e-24 |
| max | 1.3e-13 | 9.7e-14 | 2.7e-20 | 1.1e-16 | 5.4e-20 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 3.3e-16 | 2e-16 | 1.1e-20 | 1.2e-18 | 9.7e-21 |
| max | 5.5e-13 | 3.3e-13 | 3.4e-16 | 3.7e-14 | 2.2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/coll_recomb_coeff in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 5.4e-48 | 6.8e-48 | 1.3e-47 | 8.5e-50 | 6.8e-48 |
| max | 5.6e-45 | 5.6e-45 | 5.6e-45 | 8.8e-47 | 5.6e-45 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.8e-19 | 4.5e-19 | 7.3e-19 | 1.3e-19 | 4.2e-19 |
| max | 2.9e-16 | 3.1e-16 | 4.6e-16 | 1.4e-16 | 2.7e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Displaying heatmap for key /simulation/transport/transport_state/last_interaction_in_r in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 0.25 |
| max | 0.5 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 1.9e-16 |
| max | 3.8e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/gamma in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 1.4e-13 | 0 | 0 | 6.4e-14 |
| max | 0 | 1.2e-10 | 0 | 0 | 2.9e-11 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 0 | 3.4e-19 | 0 | 0 | 5e-19 |
| max | 0 | 2.2e-16 | 0 | 0 | 2.4e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum
Significant difference detected in test_montecarlo_continuum.h5, key=/simulation/plasma/beta_sobolev Maximum relative difference: 1.09e-12 (Versions differ by 1.09e-10%)
Displaying heatmap for key /simulation/plasma/beta_sobolev in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9e-17 | 8.2e-17 | 1.5e-17 | 6.2e-19 | 2.3e-18 |
| max | 1.1e-12 | 1.1e-12 | 1.1e-12 | 3.7e-14 | 9e-14 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 9e-17 | 8.2e-17 | 1.5e-17 | 6.2e-19 | 2.3e-18 |
| max | 1.1e-12 | 1.1e-12 | 1.1e-12 | 3.7e-14 | 9e-14 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/output_energy in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 1.1e-19 |
| max | 2.2e-19 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 1.1e-16 |
| max | 2.2e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/plasma/p_coll_recomb in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 2.7e-48 | 1.2e-48 | 7.4e-49 | 6.6e-52 | 2.7e-50 |
| max | 2.8e-45 | 1.1e-45 | 3.5e-46 | 6.8e-49 | 2.2e-47 |
Visualising Relative Differences
| Ā | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| mean | 1.8e-19 | 4.7e-19 | 8e-19 | 2e-19 | 4.1e-19 |
| max | 1.8e-16 | 3.5e-16 | 3.7e-16 | 2.1e-16 | 2.6e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum Displaying heatmap for key /simulation/transport/transport_state/nu_bar_estimator in file test_montecarlo_continuum.h5 Visualising Absolute Differences
| Ā | 0 |
|---|---|
| mean | 1.3e+13 |
| max | 1.8e+13 |
Visualising Relative Differences
| Ā | 0 |
|---|---|
| mean | 2.4e-16 |
| max | 3.4e-16 |
Path1: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref1/tardis/transport/montecarlo/tests/test_continuum Path2: /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7/ref2/tardis/transport/montecarlo/tests/test_continuum ================================================== Summary for test_montecarlo_continuum.h5: Total number of keys- in ref1: 148, in ref2: 148 Number of keys with different names in ref1 and ref2: 0 Number of keys with same name but different data in ref1 and ref2: 55 Number of totally same keys: 92 ==================================================
Error comparing item: /simulation/plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /simulation/plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /simulation/plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Error comparing item: /simulation/plasma/dilute_planckian_radiation_field No module named 'tardis.plasma.radiation_field'
Testing individual filesĀ¶
You can compare individual files too. Below example would work if you used example commits.
InĀ [7]:
# comparer.hdf_comparator.summarise_changes_hdf("test_generate_plot_ply__plotter_generate_plot_ply1__.h5",
# Path(comparer.ref1_path) / "tardis/visualization/tools/tests/test_liv_plot/test_liv_plotter",
# Path(comparer.ref2_path) / "tardis/visualization/tools/tests/test_liv_plot/test_liv_plotter"
# )
HDF File ComparisonĀ¶
Below graph visualises all the HDF files that changed. Each block represents a key that changed, hovering on that block would show relative percentage change for that key.
InĀ [8]:
fig_same_name = comparer.generate_graph("different keys same name")
fig_different_keys = comparer.generate_graph("different keys")
Generating graph with updated hovertemplate
Generating graph with updated hovertemplate
InĀ [9]:
fig_different_keys
InĀ [10]:
fig_same_name.layout.width = 1000
fig_same_name
Spectrum ComparisonĀ¶
You can compare TARDIS spectra for the two commits and also provide a custom path for the spectra.
InĀ [11]:
comparer.compare_testspectrumsolver_hdf(
custom_ref1_path=Path(comparer.ref1_path) / custom_ref1_spectrum_path,
custom_ref2_path=Path(comparer.ref2_path) / custom_ref2_spectrum_path
)
/Users/runner/work/tardis/tardis/tardis-regression-data/compare.py:332: UserWarning: This figure includes Axes that are not compatible with tight_layout, so results might be incorrect.
InĀ [12]:
comparer.teardown()
Removed temporary directory /var/folders/2s/h6hvv9ps03xgz_krkkstvq_r0000gn/T/ref_compare_wqhmr0_7